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EXECUTIVE SUMMARY 



A Second Exploratory Analysis of the Relations Among 
Institutional Variables is one of five studies performed in 
1976 by the Association of American Medical Colleges (AAMC) 
to examine the- characteristics of U.S\ medical schools and 
the interrelationships among variables that describe them. 
Two of the five studies are replications of previous work. 
This report is one of three that present new explorations 
of AAMC's extensive institutional data base. 

A principal components ana?ysis was performed and inter- 
preted exploring the interrelationships of 33 selected var- 
iables that describe the faculty/ student^ curriculum and 
other institutional characteristics of medical schools. The 
selection of 33 representative variables resulted from a 
series of preliminary analyses of 139 candidate variables 
from the four domains. 

Among the variables involved were several measures 
that were not available for previous studies. These included 
characteristics of the careers of aliomni and measures of tra- 
ditional research grant application and funding success. 

A summary of the concepts underlying principal components 
analysis is presented. The resulting "factor pattern" is 
presented and interpr<^ted. Eight groupings of variables were 
observed that identify the eight basic dimensions of insti- 
tutional variation in the 33 selected measures: graduate 
program emphasis, size and age, public vs. private control/ 
minority orientation/ research funding success, curriculum 
elective usage/ current development/ and research emphasis. 

Several speculative observations were made based solely 
on correlations in the data. They may or may not be upheld/ 
but it is the purpose of exploratory research to suggest 
hypotheses for further analysis. Among these. 

• Schools with an emphasis on graduate medical 
programs have proportionally fewer MD-program 
alumni going into general practice. 

• Larger and older schools have proportionally 
more^alumni receiving board certification. 

• Private schools receive greater proportions of 
their revenue from gifts and federal sources. 
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• Schools with greater proportions of female students 
have a greater rate of approval of their NIH research 
grant proposals. 

. • Curriculum information that is available concerns 
elective courses only and is independent of other 
institutional characteristics. 

9 Schools that have received larger increases in 

research funding between 1967 and 1974 tend to be 
the schools that anticipate the most growth in 
enrollment in the next five years. 

• Schools receiving the most research grants and 
expending the larger proportions of their budgets 
for sponsored research expend smaller proportions 
of their budgets for administration and general 
expense. 

Several questions and hypotheses are presented, based 
on the observed relations among the 33 variables and the 
eight basic dimensions. 
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Chapter I 
INTRODUCTION 



Background 

In the process of carrying out its many activities, 
the Association of American Medical Colleges (AAMC) 
collects a variety of data from and about U.S. medical 
schools. For purposes of accreditation review, exten- 
sive quantitative information is received annually des- 
cribing, in detail, the financial characteristics of 
each institution. The processing of vnpplications for 
admission to medical schools contributes data about 
applicants that are accumulated and aggregated in ways 
that provide more institutional measures about applicants 
and, eventually, matriculants. In addition to the finan- 
cial data, the Liaison Committee on Medical Education 
requests information about educational programs and detailed 
counts of students, faculty, and facilities. Information 
about the availability of elective courses are gathered 
to be publishc:d in the annual AAMC Curriculum Directory. 
These, together with additional data from occasional 
school surveys and other sources, are stored for ready 
retrieval in a computer based Institutional Profile 
System (IPS). 

After the data have served their primary purposes 
they remain accessible for further analysis. In recent 
years the Bureau of Health Manpower (BHM) has sponsored 
a series of exploratory analyses to exploit the data to 
learn in what basic ways U.S. medical schools are similar 
and different and how schools would group together on the 
basis of their similarities. This is a report of the 
second in a series of original exploratory factor analyses. 
As planned, new (more recent) data were available for this 
study as well as several new measures. ^ The purpose of 
the study is to examine the interrelationships of the 
currently available institutional measures, to speculate 
about common patterns of institutional functioning, and 
to add to the growing knowledge of what information may 
be contained in the rapidly expanding data base. 
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Overview 

From an extensive data base of 600 variables, 140 
potentially interesting variables were selected that 
describe faculty, student, curriculum and other ^^insti- 
tutional characteristics of U.S. medical schools. After 
a series of preliminary analyses and examinations for 
completeness, 33 variables were selected and submitted 
to a principal components analysis. From several result- 
ing factor patterns, the most interesting was reported and 
interpreted as exposing eight basic dimensions of in^^ti- 
tutional variation that summarize the information in the 
33 selected measures. Possible meanings of the association 
of individual variables with the eight dimensions are 
discussed. 

Exploratory Objectives . 

While previous examples of the use of factor analysis 
from medical education literature have been presented else- 
where (Sherman, 1975), it may be well to review the objectives 
of this approach to data analysis. The goal of the present 
study is not to answer specific research questions by empir- 
ically testing formal hypotheses. The goal is, rather, to 
explore the available data for evidence of possible rela- 
ti^Snships that may exist among the categories of data des- 
criptive of medical education. To do this one might con- 
sider examining the correlation coefficients describing 
each relationship between all pairs of variables . Given ^ 
the large number of variables at hand (over 8000 when this 
study was begun) , the problem of examining all such possible 
pairwise relationships is prohibitive. Assuming, however, 
that some form of structure exists among the complete set 
of intercorrelations of variables , and that the proper 
variables have been adequately measured, the task may be 
seen as a proper application for exploratory factor analysis . 
In the words of one of the pioneers of this method: 

When a particular domain is to be investigated 
by means of individual [for our purposes, "institu- 
tional"] differences, one^ can proceed in one of two 
ways. One can invent a hypothesis regarding the pro- 
cesses that underlie the individual ["institutional"] 
differences, and one can then set up a factorial 



10 



experiment or a more direct laboratory experiment, 
to test the hypothesis • If no promising hypothesis 
is available, one can represent the domain as ade- 
quately as possible in terms of a set of measure- 
ments of numerical indices and proceed with a fac- 
torial experiment. The analysis might reveal an 
underlying order which would be of great assistance 
in formulating the scientific concepts covering the 
particular domain. In the first case we start with 
a hypothesis that determines the nature of the meas- 
urements that enter into the factorial analysis. 
In the second case we start with no hypothesis, but 
we proceed, instead r with a set of measurements or 
indices that cover the domain, hoping to discover 
in the factorial analysis the nature of the under- 
lying order. It is this latter application of the 
factorial methods that is sometimes referred to as 
an attempt to lift ourselves by our own boot straps, 
because the underlying order in a domain cannot be 
discovered without first postulating it in the form 
of a hypothesis. This is probably the characteristic 
of factor analysis that gives it some interest as 
general scientific"*^ method. (Thurstone, 1947 , p. 55) 

Henrysson (1960) adds that "explorative factor analysis 
is to be used primarily in the mapping of a field about 
which we have little knowledge or developed theories. 
The results of such analysis can then be used for formation 
of more rigorous hypotheses and in planning experiments" 
(p. 92). Mulaik (1972) also cites the value of explora- 
tory factor analysis in generating hypotheses but acknow- 
ledges its limitations as a source of theory ; 

Factor analysis can ultimately only provis- 
ionally establish its common factors as causal 
mechanisms accounting for the relationships among 
variables. Here factor analysis must give ground ^ 
to experimental or observational techniques in which 
the researcher has direct control or observation of 
the crucial independent variables. Still one can 
think of many situations in the behavioral, social, 
and economic sciences in which direct control and 
observation of the crucial parameters are and will 
continue to be highly difficult to achieve, and it 
is in such situations that we expect factor analysis 
will continue to make valuable contributions (p. 362). 
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Principal components analysis, the form of factor 
analysis performed in the present study, is essentially 
a way of grouping variables that tend to correlate 
with one another. The number of patterns of correlations 
within and among groups of variables is smaller and more 
manageable for examination, interpretation, and possible 
hypothesis generation than would be the full correlation 
matrix. As such it is ideally suited to overcoming the 
problem of "too much data" and meeting the present explor- 
atory objectives. 

The present use of exploratory techniques is not 
intended to imply that nothing is known about medical 
education. The present study serves to supplement other 
more focused "special studies" also performed by AAMC on 
various aspects of medical education. 
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Chapter II 
METHOD 



The method used to investigate the interrelationships 
about variables that describe the characteristics of 
medical schools may be described as three steps: ^ selection 
of variables, factor extraction and rotation (principal 
components analysis) , and interpretation of the resulting 
factor pattern matrix. These steps are described in this 
chapter. 

Selection of Variables 

As of August, 1976 over 8000 variables were contained 
in AAMC's Institutional Prof ile System. Many ^ of them are 
repetitions of the same measure for several different 
years. Most of the distinct variables are gross counts, 
e.g., numbers of male students and numbers of female 
students, which, while conceptually different measures, 
are redundant in the way their values vary across insti- 
tutions. Schools with relatively large numbers of male 
students by and large are the schools with large numbers 
of female students. More subtle measures of institutional 
characteristics, e.g., percentage of females among under- 
graduate medical students, are not contained in IPS. 
Such measures are more suitable for exposing institutional 
characteristics other than overall "size". A Researchable 
Data Base was constructed to include many newly computed 
comparative measures as well as a manageable subset of 
the most recent gross counts contained in IPS. Six hun- 
dred variables in the 1976 Researchable Data Base, then, 
served as the basis for the current series of exploratory 
analyses. Details describing the construction and make-up 
of the database are contained in a descriptive report by ^ 
McShane (1977a) . 

Prom the variety of data elements available, 40 stu- 
dent, 22 faculty, 32 currifeuium and 45 institutional 
measures were closely .examined. (The initial 139 variables 
are listed in Appendix A.) It was desired to utilize 
variables that were fairly coitqplete (having recorded values 
for nearly all schools) and representative of the principal 
dimensions of variation (among schools) in each ad hoc 
conceptual domain (faculty, students, etc.) This was^ 
accomplished through a preliminary series of correlational 
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analyses during which some variables were added, deleted, 
or substituted for one another. For example, in the 
selection of a variable to represent an institution's 
faculty pay scale, the original focus was on average 
salaries of faculties at the associate professor rank 
(strict full time) for all basic science faculty, all 
clinical science faculty and fofeone representative 
department from each area (department of anatomy, depart- 
ment of medicine) . It was found that all four averages 
were highly correlated with one another. Data for all 
basic science faculty were more complete (104 schools 
reporting) than for clinical science faculty (87 schools), 
and both major groupings were more complete than the indi- 
vidual departments (56 schools each) . Therefore the 
average salary for strict-full time basic science 
faculty was chosen to represent general pay scale in 
correlations with other variables. 

Overriding the selection criteria described so far 
was a predilection for measures not available in earlier 
AAMC studies. Jn the final selection of 33 variables, 
eight were new. The eight newly available measures used 
are listed in Table 1. A complete list of the 33 selected 
variables, their means, standard deviations, and the number 
of schools for which data were available is given in 
Table 2. A glossary of abbreviations used is presented 
in Appendix B. 

Principal Components Analysis 

Principal components analysis is one of several 
data reduction procedures known generally as "factor 
analysis." The aim is to reduce the entire matrix 
of correlation coefficients between all pairs of 
variables into a smaller r more easily decipherable 
matrix without losing much of the information about how 
well pairs of variables are related. The smaller matrix 
of numbers, called a "factor pattern matrix," may be 
used to see how related variables may be grouped together 
and distinguished from less or unrelated variables. 

In the present study the 33-by-33 matrix of corre- 
lation coefficients was computed allowing each coefficient 
to be based on as many paired observations as were avail- 
able. Since some data were missing for some medical 
schools, different coefficients were based on somewhat 
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Table 1 

Variables Not Available In Previous AAMC 
Exploratory Studies but Incorporated 
in the Present Analysis. 



1. Percentage of living MD alumni in 

general practice. 

2. Percentage of living alumni who are 

board certified. 

3. Percentage of full-time and part-time 

faculty who are members of ethnic minorities. 

4. Niomber of traditional single investigator 

research grants (ROl's) approved in 
fiscal year 1975. 

5. Percentage of all ROl grant applications 

approved in FY1975. 

6. Percentage of ROl research dollars applied 

for that were awarded in FY1975. 

7. Average standardized (within study group) 

priority score assigned to approved ROl 
grant applications. 

8. Projected annual percentage change in 

first-'year enrollment over the interval 
1974-15>79. 
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TABLE 2 

MEANS, STANDARD DEVIATIONS, UNITS AND NUMBERS OF CASES 
FOR 33 SELECTED MEDICAL SCHOOL VARIABLES 
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different nximbers of pairs. The diagonal elements in 
the correlation matrix contained "I's," the correlations 
of each variable with itself. The matrix was "factored" 
initially into 9 components (the number having eigen- 
values greater than unity) accounting for 22.9, 11.4, 
9.9, 7.1, 6.2, 4.9, 4.4, 4.2, and 2.4 percent of the 
variance in the full matrix. Separate varimax rotations 
were performed on the initial 9, 8, 7, 6, 5^ and 4 com- 
ponents. Of these, the eight component solution, account- 
ing for a total of 70.5 percent of total variance, had the 
most intuitive appeal and was chosen for closer examination, 
presentation and interpretation. 

Interpretation of a Factor Pattern 

A factor pattern matrix allows for variables that 

are interrelated to be grouped together and gives a 

niomerical index of both how strongly a single variable 
belongs to a group and whether its association is 
positive or negative. With exceptions of occasional 
variables, groups are viewed as being conceptually 
independent of each other. Within this framework, the 
meaning of the several groups is hypothesized, and appar- 
ently misplaced variables give grounds for speculation. 

An understanding of these concepts will be enhaJiced 
in the next chapter where the results of the present 
analysis are presented and discussed. 
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Chapter III 
RESULTS AND DISCUSSION 



Eight Component Factor Pattern 

As a result of the procedures outlined in the 
previous chapter, eight numbers called "factor loadings" 
were derived for each of the 33 variables analyzed. The 
absolute value of the loadings represent the degree to 
which individual variables belong to each of eight group- 
ings of variables. The set of factor loadings is arranged 
in a "factor pattern matrix" having one row for each 
variable and one colximn for each "principal component" 
or grouping of variables. 

The eight component rotated factor pattern matrix is 
presented in Table 3. Thft rows of the matrix havft hftftn 
sorted to facilitate the identification of variables 
that grouped together on the basis of their inter- 
correlations. The large numbers (in absolute value) 
have been accentuated by "boxes," moderate2values by 
asterisks. (To the right of each row is h , the com- 
munality of each variable, equal to the sum of the squared 
values in each row. These values reflect the degree to 
which the information carried by each variable is con- 
tained in all rotated components.) 

As a preliminary example of the interpretation of 
the numbers in the matrix, consider the first row. 
"Average salary of strict-full-time associate professors 
in basic science departments" is seen as strongly related 
to the first group of variables since its i^alue in the 
first column is large (.84). It is related to some 
general characteristic common to all variables in group 
one, perhaps an institutional emphasis oji graduate 
medical programs. It is unrelated to the gen^^ral 
characteristics underlying each of the other seven group- 
ings since (looking across the first row) its "loadings" 
on those components are all nearly zero. Two other indi- 
vidual variables in the group (rows 3 and 5) are moderately 
related to other components (general characteristics) , 
since they have secondary loadings in columns 8 and 3, 
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EIGHT COHPONENT VARM FACTOR PATTERS RESULTING FROM 
PRINCIPAL COHPONEDTS ANALYSIS OF 33 VARIABLES 
DESCRIBING U.S. HEDICAL SCHOOLS 
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.11 


.14 


-.10 


.»4 


.04 


.07 


.13 


.77 


20 mm iHPAc: }\m std p-scr - kui APf» 


-.jS 


.04 


-.09 


.U 


-,73 


-.05 


.21 


-.05 


.n 


21 ink) W APPROVAL RATE OF NIH ROl COHP APPS 


-.04 


.29 


-.05 


.01 


.71) 


-.03 


.22 


.38* 


.78 


22 STC003 t FEMALE MD STUDENTS 


.20 


-.13 


.18 


.31 


.48 


.24 


.02 


-.28 


.56 


23 VAR273 REL ELECTIVKS: ALCOHOLISM 


.07 


.03 


-.01 


M 


-.03 


.88 


.02 


,03 


.79 


24 CRCOOZ f UF RELATED ELECTIVES OFFERED 


.03 


.14 


.12 


.01 


.14 


,82 


.01 


.24 


.78 


25 KAC01!» KAf: VOL FAC TU FT FAC 


-.12 


-.02 


-.02 


-.11 


.08 


.10 


.74 


-.30 


.68 


26 INCUUj DRG FED SFDN RES CUN5 ZCHC 67-y TO 72-4 


.U 


-.44* 


-.12' 


.15 


-.01 


.00 


.73 


.17 


.82 


27 STCIU PRUJTD ANNL I ISHR ENROLL CHG: 1974Wy 


.09 


-.43* 


-.17 


-.04 


-.01 


-.09 


JL 




.60 


28 VARJM^i DKG GRANTS * 1 ROl APPS APPROVED 


.U* 


,41* 


.05 


-.01 


.27 


.05 


-,03 


..67 


.87 


29 INCOZb I EXPD FUR AlWLN & GENL EXPENSE 


.19 


-.13 


.02 


-.li 


.15 


-.02 


.25 


-.64 


.57 


3C INCOl/ i ri)TAL EXPl) FUR SPON RESEARCH 


.24 


.13 


.45* 


-.02 


.20 


,2b 


-.04 


.b3 


.78 


31 S11045 RATI BMS GRAD-STUD TO UNDEKGRAD MD-STUD 


-.05 




■:; 


-.0!) 


.13 


.23 


,01 


.bl 


.48 


32 INC004 ADJUSTED TOTAL REVENUE 


.43* 






.o« 


.lb 


.05 


-.08 


.57 


.82 


33 STCOIJ : ISHR MD-STUDi PR&-MED CPA 3.6-4.0 


.23 


ToT 


-.06 


-.1!) 


-.04 


-.05 


-.04 


:L 


.40 


COLUMN SUM UF SQUARES 


j.3b 


3.21 


4.01 


2.H 


2.71 


l.bJ 


2.13 


3.36 




PERCENT OF VARIANCE 


14.44 


13.81 17.23 11.30 1K65 


7.95 


9.1514.4b 
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respectively. Looking dovm Column 1^ it can be seen 
that three additional variables from other principal 
components have secondary associations with an institu- 
tion ' s graduate medical education emphasis • Additional 
instruction in the interpretation of entries in a factor 
pattern matrix is given in Appendix 

The 33 variables formed eight groups that seem to 
reflect institutions' (1) graduate medical program 
emphasis, (2) size and age, (3) type of control (public 
versus private) , (4) involvement of ethnic minorities/ 
(5) research funding success, (6) use of electives in the 
curriculum, (7) stage of development, and (8) research 
emphasis. (The percentages of institutional variance in 
all eight components accounted for by each component is 
presented in the bottom row of Table 3. The percentages 

may reflect., the relative degree of ^variation, in eAch 

component, but they are affected to some degree by the 
numbers of variables in the groups.) Each of the eight 
groupings is discussed in the following sections. It 
should be kept in mind that the analysis is exploratory 
and that all interpretive observations are strictly 
tentative hypotheses. 

(1) Graduate Program Emphasis 

As characterized by the variables named in the 
first five lines of Table 3, the first principal component 
seems to describe the extent to which a medical school 
is involved in graduate medical education in addition to 
its undergraduate medical education program. Such schools 
may be typified by having a higher ratio of interns and 
residents to medical students, proportionally more faculty 
holding MD degrees, higher faculty salaries (in the basic 
sciences, but probably also in the clinical programs), and 
fewer (t-he loading is negative) undergraduate medical 
students per full-time faculty member. It may be inter- 
esting to note that relatively smaller proportions of 
former undergraduates from this type of institutional 
environment remain in general practice. Secondary 
factor loadings indicate that schools with a graduate 
program emphasis may tend to operate with larger budgets 
and have undergraduates with superior MCAT scores. 

(2) Size and Age 

The second component consists of three variables that 
are not strongly related to other components and four 
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additional variables that are shared. The essence of 
this grouping is that older schools tend to have larger 
undergraduate medical programs f larger budgets, and, 
interestingly, larger proportions of graduates who have 
become board certified specialists- The latter finding 
may be due in part to the fact that graduates from younger 
schools have had less time to achieve certification. 
Variables having secondary loadings on this principal 
component indicate that such older schools anticipate 
less growth in enrollment than do younger schools. 
They have not experienced the same proportional increases 
in federal sponsored research funding as have newer 
schools, yet they receive approval for larger numbers 
of research grants. 

(3) Type of Control (Public versus Private) 

The third principal component shows that several 
variables are related to whether a medical school is 
publicly or privately owned and controlled. Compared 
to public schools, private schools tend to have higher 
tuitions, enroll lower percentages of in-state resident- 
students, process more applications for each opening, 
and receive greater proportions of their revenues from 
federal sources (a measure which includes the recovery 
of indirect costs) and from gifts. 

A secondary loading indicates that private schools 
tend to expend greater proportions of their resources 
for sponsored research activity, much of which may be 
federally financed, thus partly explaining the dispro- 
portional income from federal sources. Another part of 
the explanation is the lack of income from state sources. 
In light of several other variables/ however, research 
emphasis seems to be generally independent of type of 
institutional control. 

(4) Involvement of Ethnic Minorities 

Characteristics of medical schools currently 
enrolling proportionately more U.S. citizens from gen- 
erally underrepresented ethnic backgrounds are shown 
in the fourth principal component. Such schools also 
have greater proportions of part-time and full-time 
faculties from minority backgrounds, greater proportions 
of non-U. S. and Canadian nationals, and students with 
lower average scores on the MCAT than have schools with 
less minority representation. It is not yet known to what 

23 
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degree this component reflects the inclusion of data from 
the two historically Black medical schools/ Howard and 
Meharry, and the University of Puerto Rico School of 
Medicine. Schools with generally higher levels of minor- 
ity involvement are not distinguished by other character- 
istics defined by the other seven principal components* 

(5) Research Funding Success 

Four of the five variables (including one secondary 
loading) comprising the fifth component. were "new" measures 
in the AAMC data base. Three pertain to applications 
for new single-'investigator research ("ROl") grants from 
NIH and NIMH, the fourth concerns alumni, and the fifth 
concerns female students . 

Research proposals submitted to NIH for funding are 
reviewed by committees of other researchers (initial 
review groups) and approved or not on the basis of the 
scientific, merit of the proposal. Those that are approved 
are assigned a "priority score," lower scores recommending 

„_greater priority to those who subsequently decide which 

projects will be funded. The institutional average priority 
scores used in this study are based on scores that had 
first been standardized by subtracting the mean and divid- 
ing by the standard deviation of all scores assigned by the 
initial review group to all approved applications from 
medical schools. 

The fifth principal component in the present analysis 
shows that schools whose proposals have the highest rate 
of approval are schools whose approved applications also 
receive more favorable priority scores. The component 
also shows the natural corollary that the same schools, 
generally, are eventually awarded a greater proportion 
of the sum of dollars requested on all reviewed proposals. 
This characteristic dimension of institutional differences 

- is apparently independent of other measures of research 
emphasis, the eighth principal component, discussed below. 

The exploratory analysis result presents two unex- 
pected correlates with success rate in research funding. 
Schools with better rates of funding success apparently 
tend to be schools with greater proportions of female 
landergraduate students. They also tend to have smaller- 
percentages of alumni in general practice. It is difficult 
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to know what to say about these findings without looking 
for additional correlates. Upon re-examination of a pre- 
liminary analysis conducted as a part of the variable 
selection process, positive correlations were found be- 
tween percentage female students and both percentage 
female faculty and percentage of all sponsored research 
that is funded by NIH. It could be envisioned that, 
given equivalent merit and quality of proposals, NIH gave 
some preference to female investigators. The linear 
correlation between percentage female faculty and ROl 
approval rate, however, is only +.25. 

(6) Electives in the Curriculum 

The sixth principal component, consisting of only two 
variables, indicates only that schools reporting the 
availability of relatively more elective courses, including 
one that covers alcoholism, are not also distinguished by 
any of the institutional characteristics described by 
other principal components. As was noted in an earlier 
study, (Sherman, 1975), the AAMC data base contains very 
little information about content of educational programs 
in medical schools. It has also been noted that components 
consisting of very few variables may be unreliable (Sherman, 
1977). 

(7) Stage of Development 

Three variables, one each from the student, faculty, 
and institutional descriptive domains grouped together, 
forming a seventh principal component that may distinguish 
developing from established medical schools. A fourth 
variable, the age of the school, has a secondary loading 
on this component. If this model is justified, developing 
schools are seen to be younger , utilize larger proportions 
of volunteer faculty, and project larger increases in 
enrollment than do other schools. Developing schools have 
also experienced relatively larger proportional increases 
in federally sponsored research revenues in recent years 
(1967 through 1974) than have more established schools. 
It may be interesting to note that the ratio of volunteer 
faculty to salaried full-time faculty appears to be more 
strongly related to a development component than to graduate 
medical program emphasis (component 1) as may have been 
expected. As discussed above, the two percentage change 
measures have secondary loadings on the "size and age" 
component (niimber 2). 

25 
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(8) Research Emphasis 

Extent and emphasis of sponsored research activity 
seems to be the common theme of variables loading on the 
last principal component. Six variables are primarily 
related and four variables have secondary loadings on 
this component. Three of the primary variables are also 
related to other principal components and are discussed 
above in other contexts . 

Schools with a research emphasis may be characterized 
by relatively high percentages of budgets expended for spon- 
sored research, large numbers of research grants approved, 
high ratios of basic medical science graduate (M.A. and 
Ph.D.) students to undergraduate (M.D.) medical students, 
high percentages of students with superior pre-medical 
grade point averages, and low percentages of expenditures 
for administration and general expense. Some of the inverse 
relationship observed between research and administration 
expenditure percentages is artif actual, since they are per- 
centages of the same total. It may be hypothesized, how- 
ever, that above a certain level of activity, additional 
sponsored research does not add noticeably to administrative 
expenses. Adjusted total revenue is related to the extent 
of sponsored research as well as to the sizes of the graduate 
and undergraduate medical programs* . Schools with a research 
emphasis tend to report more faculty per student and greater 
percentages of revenue from federal sources (including the 
recovery of indirect costs) . They have students with higher 
academic qualifications (in terms of MCAT scores and CPA's) 
and somewhat better than average rates of approval of their 
"ROl" research grant proposals, though the latter seems 
more strongly related to proxy measures of quality of the 
research proposals (component 5, discussed). Few of these 
observations are surprising and tend, rather, to affirm 
confidence in the available data. 
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' Chapter IV > f^J^ 

■ . "■■^%> 

CONCLUSION ?; VtS^ 

... - -^^-^ ■ 

Caveat 

This study, like other studies in the series, was 
exploratory , designed yto stimulate hypotheses rather than 
to answer specif ic qu'festions . The method used was pre- 
dominantly objective but also somewhat restrictive in its 
assumptions and subjective in its application. In view 
of these conditions, any observations must be considered 
tentative. and best expressed. as questions or hypotheses 
about medical education institutions, and, occasionally, 
about the data collected to study their operations. 

Observations 



A clear pattern emerged from a principal components 
analysis of 33 selected variables. While individual var- 
iables may be related to more than one component, the eight 
components may be hypothesized to be functionally inde- 
pendent. For example, whether or not a medical school 
has a graduate medical education program may be independent 
of the school's age, whether it is public or private, and 
whether it places strong emphasis on research. The eight 
components discernable in the patterns of variation in 
the particular variables selected are (1) graduate medical 
programs/ (2) size and age, (3) type of control, (4) ethnic 
minority involvement, (5) research funding success, (6) cur- 
ricular offering of electives, (7) stage of development, 
and (8) research emphasis. 

Some observed relationships and anomalies may 
merit further investigation with appropriate data trans- 
formations and quasi-experimental controls. Are medical 
schools with graduate programs unduly, even inadvertently, 
encouraging specialization to their undergraduate students? 
Are graduates of older and larger schools more likely to 
achieve board certification? If so, why? What is the 
direct or indirect relationship between the presence of 
females and a school's research funding success rate? 
Is there a ceiling to incurred indirect costs when spon- 
sored research activities are expanded? 
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A dearth of quantified data about curricula was 
noted. The feasibility of adding comparative curricular 
information to the database may be worth exploring. 

The emergence from this study of an apparently more 
sensible pattern than those achieved in studies using 
older data may evidence improvements in data acquisition 
and quality control. 

Further Studies 

Based on the findings of iA^V -study, sE?y " -^''"^^^r.^-^ y 
examinations of the data can be envisioned and some are 
already being performed. 

Some studies could be designed to focus on individual 
relationships between pairs of variables, with extra care 
given to data transformations and possible covariates. 

For each school, factor scores can be computed to 
establish each school's location on the dimensions de- 
scribed by each component. Such scoi'es are being used by 
McShane (1977b) to cluster similar schools into natural, 
empirical groupings. 

It was noted that graduate medical program emphasis 
and research emphasis are distinct components of medical^ 
school operations. A school may be .characterized by having 
one, both, or neither of these emphases. Or they may 
possess either emphasis to some degree. As was suggested 
in an earlier study, it may be meaningfully descriptive to 
answer the question "How are schools distributed on a plane 
whose two axes are 'research emphasis" and 'health care 
delivery [or graduate medical program] emphasis"? (Sherman, 
1975, p. 62). A study which attempts to answer this ques- 
tion is currently underway at AAMC. 
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Appendix A 

Initial 139 Variables Selected 
for Exploratory Analysis 





STUDENT 


VARIABLES 


1. 


VAR016 


# MD-STUDENTS 


2. 


VARO 8 8 


IST-YR MD-STUD: OVERALL GPA 


3. 


VAR09 0 


IST-YR MD-STUD • MCAT VERRAT. ^rORF 


4. 


VARO 9 3 


1ST— YR MD-STUD • MCAT SCIENCE ^CORF 


5. 


VARO 9 4 


1ST— YR MD-STUD- AVERAGE AGF 


6. 


STCOOl 


% FEMALE iST-YR MD «5TTTnFNT^ 


7. 


STC003 


% FEMALE MD STUDENTS 


8. 


STCOO 8 


% NON US-CANADIAN IST-YR MD-STUD 


9. 


STC013 


% IST-YR MD-STUD* PRF— MFD GPA '\ f.-'A 0 


10. 


STC 015 


% IST-YR MD-STUD- PRE-MED GPA ^ 2 S 


11. 


STC025 


% IST-YR MD-STUD* MASTERS OR PHD 


12 . 


STC02 9 


% IN— STATE 1 ^T— YR MD- ^TUD 


13. 


STC032 


% IST-YR MD-STUD WITHDREW. ArAHFMTr 


14 . 


STC 03 8 


% 1ST— YR MD— ^TUD WTTHDRFW- AT.T. • • 


15. 


STC 04 1 


ft MD— ^TUD WITHDREW. ALL 


16 . 


STC 04 2 


# P09T— GRAn Mn— 9TTTn — HHTT^F^TAFF 


17. 


STC04 3 


RAT- HHTT^F^TAFF TH TTMnFRnPAn MH — QTTTH 


18 


O U *f J 


PAT- PMQ fIRAn— 9TTTn TH TTTJnFRf^PAn MH— ^TTTH 


19. 


STC052 


5k HHTT^F^TAFF PO^TTTOTJ^ TTMFTTT.Fn 


20 . 




% FMn HHTT^F^TAFF 
V r ni^u ox«o x/\r r 


21. 




HHTT^F^TAFF Pn^TTTHM^ 
IT ni^ uox«o x/ix r xri^ox x x^imo 


^ ^ . 


^Tr* n ^ 7 


St Mn— QTTTn APPT.V PTM a TH 




O X L« U U J 


9k AT.T. APPT THMTQ P'Pr* FTTJ 2i TH PP M'PH-.Qr'H 
9 rVlJlJ /vtr xrlJ xl^IN X O TxIM /ixL/ TIN i*lC«iJ O^Il 


24. 


STC073 


$ AWARDED PER MD-STUD REC AID 


25. 


STC082 


% UNDERREP MINORITY iST-YR MD-STUD 


26. 


STC08 3 


% FOREIGN NATIONAL IST-YR MD-STUD 


27. 


STC084 


RAT: APPLICANTS PER IST-YR MD-STUD 


28. 


STC087 


RAT: MINORITY APP PER MIN IST-YR MD-STUD 


29. 


STC090 


% UNDERREPRESENTED MINORITY APPLICANTS 


30. 


STC091 


% FEMALE APPLICANTS 


31. 


STC092 


% IN-STATE APPLICANTS 


32. 


STC094 


DIFF: MEAN MATRIC-MEAN APP AGE 


33. 


STC095 


DIFF: MEAN MATRIC-MEAN APP OVERALL GPA 


34. 


STC096 


DIFF: MEAN MATRIC-MEAN APP SCIENCE GPA 


35. 


STC097 


DIFF: MEAN MATRIC-MEAN APP MCAT VERBAL 


36. 


STClOO 


DIFF: MEAN MATRIC-MEAN APP MCAT SCIENCE 


37. 


STC105 


% LIVING MD-ALUMNI IN GENERAL PRACTICE 


38. 


STC112 


% LIVING MD ALUMNI BOARD CERTIFIED 


39. 


STC113 


% ACT LIV MD ALUM ON FAC OF OTHER MD-SCH 


40. 


STC114 


PROJTD ANNL % IST-YR ENROLL CHG: 1974-79 




FACULTY 


VARIABLES- 


1. 


VAR151 


# FT BAS SCI FAC 


2. 


VAR158 


# FT CLINICAL FACULTY 


3. 


VAR166 


# PART TIME PT FACULTY IN MED-SCH 


4. 


VAR16 7 


# VOLUNTEER VOL FACULTY IN MED-SCH 


5. 


VAR38 8 


AV SALARY - SFT ASSOC PROF BASIC SCIENCE 


6. 


VAR389 


AV SALARY - SFT ASSOC PROF CLINICAL SCI 


7. 


VAR390 


AV SALARY - SFT ASSOC PROF MEDICINE 


8. 


VAR391 


AV SALARY - SFT ASSOC PROF ANATOMY 


9. 


FACOOl 


% PT & FT SAL FAC WITH MD 


10. 


FAC002 


% PT & FT SAL FAC WHO ARE FMG'S 
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11* FAC003 % PT & FT SAL FAC WHO ARE FEMTOuE 

12. FAC004 % PT & FT SAL FAC FROM ETHNIC MINORITIES 

13*. FAC005 % PT & FT SAL FAC: IN-BRED MD 

14. FAC008 RAT: BAS SCI FT FAC TO CLIN FT FAC 

15. FACOlO ANNUAL PT & FT FAC TURNOVER RATE 

16. FACOll % FT BAS SCI FAC ASSOC PROF & ABOVE 

17. FAC012 % FT CLIN FAC ASSOC PROF & ABOVE 

18. FAC015 % VACANT BAS SCI FAC POSITIONS 

19. FAC016 % VACANT CLIN FAC POSITIONS 

20. FAC017 f RAT: FT FACULTY TO MD STUDENTS 

21. FAC018 RAT: PT FAC TO FT FAC 

22. FAC019 RAT: VOL FAC TO FT FAC 



CURRICULUM VARIABLES 



1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 

11. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 

21. 

22. 

23. 

24. 

25. 

26. 

27. 

28. 

29. 

30. 

31. 

32. 



VAR269 
VAR270 
VAR271 
VAR272 
VAR273 
VAR274 
VAR275 
VAR276 
VAR277 
VAR278 
VAR279 
VAR280 
VAR2 81 
VAR282 
VAR283 
VAR284 
VAR285 
VAR286 
VAR287 
VAR288 
VAR289 
VAR290 
VAR293 
VAR295 
VAR297 
VAR301 
VAR302 
VAR305 
VAR306 
VAR307 
VAR308 
VAR309 



SPEC ADVISORY PROGRAMS FOR DISADV MD-STU 
MD-STUD RET ACT: TUTORING BY FACULTY 
MD-STUD RET ACT: TUTORING BY MD-STUD 
FORMAL PROG FOR PHD SEEKING MD 



REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL ELECTIVES 
REL E^:,ECTIVES 



ALCOHOLISM 

BIOMEDICAL ENGINEERING 
COMMUNITY MEDICINE 
DRUG ABUSE 
EMERGENCY MEDICINE 
ETHICAL PROBLEMS IN MED 
GERIATRICS 

HEALTH CARE DELIVERY 
HUMAN SEXUALITY 
MEDICAL HYPNOSIS 
MEDICAL JURISPRUDENCE 
NUTRITION 
PATIENT EDUCATION 
POPULATION DYNAMICS 



PRIMARY CARE 
CURR INNOV: CLINICAL APPL OF COMPUTERS 
CURR INNOV: COMPUTER ASSISTED INSTRUCT. 
CURR INNOV: AMBULATORY CARE PROGRAM 
GRADING: LETTER-NUMBER GRADES 
CURR ADM: CURR EVALUATION COMM. 

# MONTHS REQUIRED TO COMPLETE MD - MIN 
COMBINED MD-PHD PROGRAM 

MD PROGRAM FOR PHD'S - REDUCED TIME 

# OF REQUIRED CLERKSHIPS 

FAMILY MED TRNG PROG FOR UNDERGRAD MD-ST 
OTHER PRIMARY CARE PROGRAM FOR UG MD-STUD 
MD-STUD REQUIRED TO TAKE NBME-1 
MD-STUD REQUIRED TO TAKE NBME-2 



INSTITUTIONAL VARIABLES 

1. VAR002 CONTROL: 0 = PUBLIC, 1 = PRIVATE 

2. VAR180 # DEANS APPOINTED, 1960-1976 

3. VAR248 # BEDS AVAILABLE FOR CLINICAL EDUC. 

4. VAR251 # OUTPAT VISITS PER YEAR: ALL CLIN FACIL 

5. VAR352 IMPAC: MEAN STD P-SCR - ROl APP 

6. VAR353 IMPAC: SO STD P-SCR - ROl APP 

7. VAR384 DRG GRANTS - # ROl APPS APPROVED 

8. VAR386 DRG GRANTS - $ AMT OF ROl APPS AWARDED 
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9. 


VAR394 


1975-76 RESIDENT MD-STUDENT TUITION 


10. 


INCOOl 


RAT: POP IN SMSA TO MD-STUD IN SMSA 


11. 


INC002 


LCME FED SPON RES CON $ % CHG 67-9 TO 1 


12. 


INC003 


DRG FED SPON RES CON S % CHG 67-9 TO 72« 


13. 


INC004 


ADJUSTED TOTAL REVENUE 


14. 


INC007 


% 


REV FROM FED SOURCES & RCOV INC COSTS 


15. 


INC008 


% 


FEV FROM TUITION & FEES 


16. 


INC012 


% 


REV FROM ALL GIFTS 


17. 


INC013 


% 


REV FROM STATE- GOVERNMENTS 


18. 


INC014 


% 


SPONSORED RES REV FROM FED GOVT 


19. 


INC017 


% 


TOTAL EXPD FOR SPON RESEARCH 


20. 


INC018 


% 


REV FROM INDIRECT COST RECOVERY 


21. 


INC019 


. % 


REV^ FROM PROFESSIONAL FEES 


22 . 


TNC02 0 


% 


EXPD FOR MED INSTR & DEPT RES 


23 . 


INC022 


% 


EXPD FOR OTHER SEP BUDGETED RES 


24 . 


INC023 


% 


REV FOR SPONS TCH-TRN 


25 . 


INC024 


% 


EXPD FOR MULTI-PURPOSE & SERVICE PGMS 


2 6. 


INC025 


% 


EXPD FOR OPER & MAINT OF PHYS PLANT 


27 . 


INC026 


% 


EXPD FOR ADMIN & GENL EXPENSE 


28 . 


INC027 


% 


SPONS PGM EXPD FROM FEDS 


29. 


INC029 


% 


SPONS PGM EXPD FROM NON-GOVT 


30. 


INC03- 


% 


FED SPONS RES $ FROM NiH 


31. 


INC035 


# 


OWNED OR AFFIL CLINICAL FACILITIES 


32. 


JL w w ^ w 


RAT: $ EXPD PER FT FACULTY 


33. 


INC037 


RAT: PROFESSIONAL F. PER FT CLIN FAC 


34. 


INC038 


RAT: AVAIL TCHNG BEDS PER MD-STUDENT 


35. 


INC039 


RAT: SPONS PGM EXPD PER FT FAC 


36. 


INC058 


RAT: MD STUDENTS TO FT FAC 


37. 


INC059 


RAT: TOTAL STUDENTS TO FT FAC 


38. 


INC043 


REG OPER EXPD: TOTAL MINUS SPONSORED 


39. 


INC044 


RAT: REG OPER EXPD PER MD-STUDENT 


40. 


INC045 


TRG APPROVAL RATE OF NIH ROl COMP APPS 


41. 


INC046 


NIH-NZMH ROl $ AWARD AS % OF $ APP SBMT 


42. 


INC047 


AVERAGE $ AWARD PER ROl APP APPROVED 


43. 


INC048 


LOG AGE OF MEDICAL SCHOOL 


44. 


INC054 


% 


EXP FOR SPONSORED PROGRAMS 


45. 


INC057 


RAT: REG OPER EXPD PER FT FAC 
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Abbreviations Used in 1976 
Researchable Data Base Variable Labels 



s 


Dollars 


iT 


Number 


% 


■ Percent - 


% Chg 


Percent Change 


A-Health 


Allied Health 


Accel 


Accelerated 


Act 


Avcite , Activity 


Ad IB 


Administration 


Adinin & GenT 


Administration & General 


Admt 


Admi tted 


Adm-Pref 


Admittance-Preference 


Adu Stda 


Advanced Standing 


AEC 


Atomic Energy Commission 


Af f il 


Affiliated 


Agrmt 


Agreement 


Alum 


Alumni, Alumnae 


Aitier' 


American 


Amt 


Amount 


Annl 


Annual 


Add 


Applications / Applicant 


Applicnts 


Applicants 


AddIv 


Applvincj 


Appr 


Appropriations 


Assist 


Assistant (ASST) 


Assoc 


Associate 


Avail 


Available 


Av 


Average 


BA 


Bachelor of Arts 


Bas 


Basic (Sciences) 


Bal 


Balance 


BHRD 


Bureau of Health and Resources 




Development 


BMS 


Basic Medical Sciences 


BS 


Bachelor of Science 


Budg 


Budget (ed) 


Bus & Ind 


Business and Industry 


Ch 


Choice 


Chg 


Change 


Clin 


Clinical (Sciences) 



33 



- 28 - 



APPENDIX B (Continued) 



Coll College 

Coimti Committee 
Comp , Competing 

Con$ Constant Dollars (adjusted for 

- •• dlnflation) ~ 

Curr Curriculum 

Def Deficit 

Deg Degree 

Dept Department (al) 

DHEW Dept. of Health, Education and Welfare 

Diff Difference 

Dir Direct 

Disadv Disadvantaged 

Dist Distributed " 

DOD Dept of Defense 

DRG Division of Research Grants (NIH) 

Ed Education, Educational (Educ) 

Elec Electives 

Emerg-Med Emergency Medicine 

Endow Endowments 

Enroll Enrollment 

Equivs Equivalents 

Exp Expenditure s ( Expd ) 

Fac Faculty 

Facil Facility 

Fed Federal 

Fern Female 

Fin Financial 

Fin-Yr Final Year 

FMG Foreign Medical Graduate 

Fr From 

FT Full Timec 

Gen General 

Govt Government 

GPA Grade Point Average 

Grad Graduate 

GT Greater than 

HMO Health Maintenance Organization 

IMPAC org's computer file of grants & 

contracts 
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APPENDIX B (Continued) 



Incl Including 

Indir Indirect (Ind) 

Innov Innovations 

Instr Instructor 

Instrct Instructional 

Intrn Interns 

IRG Initial Review Group (study section) 

LCME Liaison Committee on Medical Education 

Liv Living 

Log Logarithm 

LT Less Than 

Matric Matriculant 

MCAT Medical College Admissions Test 

MD-Stud Medical Student 

Med Medical 

Med-Sch Medical School 

Mid-Yr Middle Year 

Min Minority 

Mnlnd Mainland 

MS Master's degree 

Multi-Purp Multi- Purpose (MP) 

Multi-Serv Multi-Service 

NBME-1 National Board Medical Examiners 

(test) - Part I 

NBME-2 National Board of Medical Examiners - 

Part II 

NIH National Institutes of Health 

NIMH National Institute of Mental Health 

Non-Govt Non-Governmental 

Non-Res Non-Resident 

NSF National Science Foundation 

Oper & Maint Operation and Maintenance 

Org Organized/ Organizational 

Outpat Out patient 

P-Scr Priority Score 

P01 Program and Project Grants 

Phys Physical 

Pop Population 

Pos Position 

Post-Docs Post-Doctorates 

Post-Grad Post-Graduates 

Prc\c Practice 
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APPENDIX B (Continued) 



Pre-Med 


Pre - Medical 


Priv 


Private 


Prof 


Professional 


Procj 


Brogram (Pgin) 


Pro j td 


Projected 


PT 


Part Time 




Public 


Qudnti 


Quantitative 




Traditional Research Grants 


rvo, u 


Ratio 


Rec 


Received 




Re cove r y ( RC OV ) 




Regular Operating Expenditures 




Related 




Research 




Reserves 


Ret 


Retention 


P(^\7 
X\w V 


Revenues 




Resident 


Sal 


Salary 


SBMT 


Submitted 


Sch 


School 


Sci 


Science 


SD 


Standard Deviation 


Sep 


Separately 


Serv 


Service 


SFT 


Strict Full Time 


SMSA 


Standard Metropolitan Statistical 




Area 


Spec 


Special, Specialty 


Spons 


Sponsored 


Sq 


Square 


St & Log 


State and Local (S&L) 


St Rel 


State Related 


Std 


Standardized 


Stud 


Student 


Tch-Trn 


Teaching and Training 


Tchng 


Teaching 


Tot 


Total 


Undergrad 


Undergraduate (Ungrad, UG) 
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Underrep Under-represented 

Unk Unknown 

Unrestr Unrestricted 

US-Can United States and Canadian 

Vol Volunteer 

Yr Year 
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Interpretation of the Factor Pattern Matrix 



An understanding of the interpretation of the rumerical 
"loadings" that comprise the factor pattern matrix facilitates 
the assessment of the results the factor analysis used for 
exploratory purposes. 

The nxambers in a table of "factor loadings" are measures 
of strength of association between the variables and the de- 
rived "factors". Like correlation coefficients representing 
the relationship between pairs of simple variables, they 
range in value from +1.0 to -1.0. Values near zero rispre- 
sent "no relationship"; values near +1.0 or near -1.0 repre- 
sent strong positive and strong negative relationships respec- 
tively. The first row shows hov; strongly the first variable 
is relatedfeach factor. Because of the rotational criterion, 
any one variable is probably highly related to only one or 
two factors and v/eakly related, at best, to the other factors. 
For purposes of speculation it is assumed that variables re- 
lated to the sarae factor are likely to be related to each 
other. 

For ease of examination, the variables in the table are 
often ordered according to their highest factor loadings. 
The predominant loading (or loadings) for each variable are 
highlighted v/ith a "box" (for high values) or an "asterisk" 
(for moderately high values) . The grouping of variables 
means that they may be related to one another, that is, their 
values vary the same v/ay across institutions. At any given 
school, high standardized values of one variable tend to be 
matched with high values of the other, low with low^ if the 
relationship is positive, that is, if the signs on the load- 
ings are the same (both "plus" or both "minus") . If the 
signs of two variables' loadings are different (one "plus" 
and one "minus") the relationship is probably negative, that 
is, high standardized values of one variable are matched with 
low values on the other. Because the factors are numerically 
independent of one another (due to the rotational procedure 
used) , it is also likely that the variables in one group have 
low correlation with variables in another group. Exceptional 
variables are readily seen. 

By way of additional guidance in the interpretation of 
the factor pattern matrices, two additional rules of thumb 
may be useful. First, factor loadings with value less than 
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about .50 (in absolute value) should not be given as much 
attention as larger numerical loadings. Second ^ variable 
groupings that account for small percentages of overall vari- 
ance (given at the bottom of each column) may be less accurate 
indicators of potential relationships than groupings account- 
ing for greater percentages of variance. 

Whereas the named "factors" may be conceptually or 
matically independent and most variables related ^jf^iy '^^^ 
factor f some individual variables may be found to be related 
to more than one factor. This may be more easily understood 
through a simple analogy. Iff instead of medical schools , 
rectangles were the unit of study , their height, width, and area 
might be among the measured variables. As a result of ana- 
lysis ^ height and width may be found in a common factor with 
area^ but^ since height and width are independent of each 
other f one or both may also be found .in additional factors 
(variable groupings) . 
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